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Aims. We present in this paper an innovative data reduction method for single-mode interferometry. It has been specifically developed for 
the AMBER instrument, the three-beam combiner of the Very Large Telescope Interferometer, but can be derived for any single-mode 
interferometer. 

Methods. The algorithm is based on a direct modelling of the fringes in the detector plane. As such, it requires a preliminary calibration of 
the instrument in order to obtain the calibration matrix which builds the linear relationship between the interferogram and the interferometric 
k>( , observable, that is the complex visibility. Once the calibration procedure has been performed, the signal processing appears to be a classical 
» I ■ least square determination of a linear inverse problem. From the estimated complex visibility, we derive the squared visibility, the closure 
' phase and the spectral differential phase. 
Results. The data reduction procedures are gathered into the so-called amdlib software, now available for the community, and presented in 
this paper. Furthermore, each step of this original algorithm is illustrated and discussed from various on-sky observations conducted with the 
VLTI, with a focus on the control of the data quality and the effective execution of the data reduction procedures. We point out the present 
limited performances of the instrument due to VLTI instrumental vibrations, difficult to calibrate. 



Key words. Technique: interferometric - methods: data analysis - instrumentation: interferometers 



1. Introduction 

AMBER i s the first- generatio n near-infrared three-way beam 
combiner JPetrov et alJ I2006I) of the Very Large Telescope 
Interferometer (VLTI). This instrument provides simultane- 
ously spectrally dispersed visibility for three baselines and a 
closure phase at three different spectral resolution. AMBER 
has been designed to investigate the milli-arcsec surrounding 
of astrophysical sources like young and evolved stars, active 
galactic nuclei and possibly detect exoplanet signal. The main 
new feature of this instrument compared to other interferomet- 
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ric instrument is the simultaneous use of modal filters (optical 
fibers) and a dispersed fringe combiner using a spatial coding. 
The AMBER team has therefore investigated carefully a data 
processing strategy for this instrument and is providing a new 
type of data reduction method. 

Given the astonishingly quick evolution of ground based 
optical interferometers in only two decades, in terms of base- 
line lengths and number of recombined telescopes, the interest 
of using the practical characteristics of single mode fibers to 
carry a nd recombine the light, as first proposed bv lConnes et alJ 
( 1987) with his conceptual FLOAT interferometer, is now well 
established. Furthermore, in the light of the FLUOR exper- 
iment on the IOTA interferometer, which demonstrated for 
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the first time the "on-sky" fea sibility of such interferometers, 
ICoude Du Foresto et al.l dl997l) showed that making use of sin- 
gle mode waveguides could also increase the performances 
of optical interferometry, thanks to their remarkable proper- 
ties of spatial filtering which change the phase fluctuations of 
the atmospheric turbulent wavefront into intensity fluctuations. 
Indeed, by monitoring in real time these fluctuations thanks 
to dedicated photometric outputs and by performing instanta- 
neous photometric calibration, he experimentally proved that 
single mode interferometry could achieve visibility measure- 
ments with precisions of 1% or below. Achievement of such 
level of performances has since been confirmed with the IONIC 
inte grated optic beam comb iner set up on the same interferom- 
eter (iLeBouauin et all2004 . 

Surprisingly, the effect of single mode waveguides on the 
interferometric signal ha s been only recentl y studied from a 
theoretical point of view. iRuilier et ai1 dl997h showed through 
numerical simulations in presence of partial correction by 
Adaptive Optics that spatial filtering provided a gain on the 
visibility signal to noise ratio. However his study was lim- 
ited to the case of a point source. The case of sources 
with given spatial extent w as first theoretically addressed by 
lDver&Christensenl(ll999l) from a geometrical point of view. 
They proved that the visibility obtained from single mode in- 
terferometry was biased, the object being multiplied by the an- 
tenna lobe (the point spread function of on e single telescope ) 
exactly as it happens in radio interferometry jGuilloteaul200l . 
An equivalent geometrical bias was als o chara cterized for the 
closure phase dLongueteau et alJl2002h . Then iGuvonl d2002h 
noticed on his simulations that took into account the presence 
of atmospheric turbulence, that interferometric observations of 
extended objects (resolved by one single telescope) could not 
be completely corrected from atmospheric perturbations, there- 
fore lowering the performances of single mode interferometry. 
Finally, by thoroughly describing the propagation of the elec- 
tric field through single mode waveguides in the general case 
of partial correction by Adaptive Optics and for a source with 
given spatial extent, iMege et all d2003h unified previous stud- 
ies and introduced the concept of modal visibility, which in 
the general case does not equal the source visibility V a and ex- 
hibits a jointly geometrical and atmospheric bias. Nevertheless 
they also showed that for compact sources, i.e. smaller than 
one Airy disk, the mutual coherence factor fi could be written 
under the form of a simple product fj. = TjT a V where T, and 
T a are respectively the instrumental and the atmos pheric trans- 
fer fun ctions which can be calibrated. Recently. iTatulli et alJ 
ll2004 deduced from an analytical approach that in the specific 
case of compact objects, the benefit brought by single mode 
waveguides is substantial, not only in terms of signal to noise 
ratio of the visibility but also on the robustness of the estimator. 

Hence, following the path opened by the FLUOR exper- 
iment, the A MBER instrument - the three-beam combiner 
of the VLTI dPetrov et al.1 120061) - makes use of the filter- 
ing properties of sin gle mode fibers. However, on the con- 
trary of FLUOR, PTl1cokdvitalll999al) or VINCI on the VLTI 
dKervella et alJl2003h where the fringes are coded temporally 
with a movable piezzo-electric mirror, the interference pattern 
is scanned spatially thanks to separated output pupils which 



separation fixes the spatial coding frequ ency of the fringes, a s 
in the case of the GI2T interferometer dMourard et aljl200(i) . 
Thus, if data reduction methods have already been pro posed for 
single mode interferometer s using temporal coding (Colavita 
ll999btlKervella et all2004 . this paper is the first that presents 
a signal processing algorithm dedicated to single-mode inter- 
ferometry with spatial beam recombination. Moreover, in the 
case of AMBER, the configuration of the output pupils, that 
is the spatial coding frequency, imposes in the three telescopes 
case a partial overlap of the interferometric peaks in the Fourier 
plane. As a consequence, the data redu ction based on the clas- 
sical estimators in t he Fourier plane dRoddier & Lenalfl984l 
iMourard etalll 19941) cannot be performed. The AMBER data 
reduction procedure is based on an direct analysis in the detec- 
tor plane, which princ iple is an optimi zation of the "ABCD" 
estimator as derived in lColavital dl999bl) . The specificity of the 
AMBER coding and its subsequent estimation of the observ- 
ables arises from the will to characterize and to make use of the 
linear relationship between the pixels (i.e. the interferograms 
on the detector) and the observables (i.e. the complex visibil- 
ities). In other words, the AMBER data reduction algorithm 
is based on the modelling of the interferogram in the detector 
plane. 

In Sect. 13 we present the AMBER experiment from a 
signal processing point of view and we introduce the inter- 
ferometric equation governing this instrument. We develop in 
Sect. |3 the specific data reduction processes of AMBER, and 
then derive the estimators of the interferometric observables. 
Successive steps of the data reduction method are given in 
Section @J as performed by the software provided to the com- 
munity. Finally, the data reduction algorithm is validated in 
Sect. |5] through several "on-sky" observations with the VLTI 
(commissioning and Science Demonstration Time (SDT)). 
Present and future performances of this instrument are dis- 
cussed. 

2. Presentation of the instrument 

2.1. Image formation 

The process of image formation of AMBER is sketched on 
Fig.^Geft) from a signal processing point of view. It consists 
in three major steps. First, the beams from the three telescopes 
are filtered by single mode fibers to convert phase fluctuations 
of the corrugated wavefronts into intensity fluctuations that are 
monitored. The frac tion of light entering the fi ber is called the 
coupling coeffic ient dShaklan & Roddier ll98S) and depends on 
the Strehl ratio dCoude du Foresto et alj|2000l) . At this point, a 
pair of conjugated cylindrical mirrors compresses by a factor 
of about 12 the individual beams exiting from fibers into one 
dimensional elongated beams to be injected in the entrance slit 
of the spectrograph. For each of the three beams, beam-splitters 
placed inside the spectrograph select part of the light and in- 
duce three different tilt angles so that each beam is imaged at 
different locations of the detector. These are called photometric 
channels and are each one relative to a corresponding incoming 
beam. The remaining parts of the light of the three beams are 
overlapped on the detector image plane to form fringes. The 
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Fig. 1. Left panel: Sketch of the AMBER instrument. The light enters the instrument from the left and is propagating from left 
to right, until the raw data are recorded on the detector. Further details are given in the text. Right panel: AMBER reconstituted 
image from the raw data recorded during the 3-telescope observation of the calibrator HD 135382 in February 2005, in the 
medium spectral resolution mode. DK corresponds to a dark region, Pk are the vertically dispersed spectra obtained from each 
telescope and IF is the spectrally dispersed interferogram. 



Table 1. Detector properties. 



Detector specifications 



Society/Name 
Composition 
Number of pixels 
Pixel size 
Spectral width 
Readout noise 
e-/ADU 
Cooling 
Temperature 
Autonomy of cryostat 



Rockwell/HAWAII 
HgCdTe 
512x512 
18.5/jm x 18.5yum 
0.8/um - 2.5fim 
9e~ 
4.18 
Liquid nitrogen 
78K 
24h 



spatial coding frequencies of the fringes / are fixed by the sep- 
aration of the individual output pupils. They are respectively 
/ = [l,2,3]d/ A, where d is the output pupil diameter. Since 
the beams hit a spectral dispersing element (a prism glued on 
a mirror or one of the two gratings) in the pupil plane, the in- 
terferogram and the photometries are spectrally dispersed per- 
pendicularly to the spatial coding. The dispersed interferogram 
arising from the beam combination, as well as the photometric 
outputs are recorded on the infrared detector, which character- 
istics are given in Tabled 

The detector consists in a 512 x 512 pixel array with the 
vertical dimension aligned with the wavelength direction. The 
first 20 pixels of each scanline of the detector are masked and 
never receive any light, allowing to estimate the readout noise 
and bias during an exposure. The light from the two (resp. 3) 
telescopes comes in three (resp. 4) beams, one "interferomet- 
ric" beam where the interference fringes are located, and two 
(resp. three) "photometric" beams. These 3 (resp. 4) beams 
are dispersed and spread over three (resp. 4) vertical areas on 
the detector. The detector is read in subwindows. Horizontally, 
these subwindows are centered on the regions where the beams 
are dispersed, with a typical width of 32 to 40 pixels. Vertically, 
the detector can be set up to read up to three subwindows (cov- 



ering up to three different wavelength ranges). The Raw Data 
format used by AMBER records individually these subframes. 
However, as sketched in the right panel of Fig.^ the AMBER 
Raw Data can be conceived as the grouping together of these 
subwindows: 

- the left column (noted "DK" ) , contains the masked pixels. 

- the two following columns (noted "PI" and "P2"), and 
the right one in the three telescope mode (noted "P3"), of 
usually 32 pixels wide, are the photometric outputs. They 
record the photometric signal coming from the three tele- 
scopes. When dealing with 2-telescope observations, only 
channels PI and P2 are enlighted. 

- the fourth column is the interferometric output (noted 
"IF"), it exhibits the interference fringes arising from the 
recombination of the beams (that is two or three beams, ac- 
cording to the number of telescopes used). We call N P j X the 
number of pixels in this column, which is usually N p i x = 
32. 

The individual image which is recorded during the detector in- 
tegration time (DIT) is called a frame. A cube of frames ob- 
tained during the exposure time is called an exposure. 

2.2. AMBER interferometric equation 

The following demonstration is given considering a generic 
Ntel ^ 2 telescope interferometer. In the specific case of 
AMBER however, N le i — 2 or Ntel — 3 only. Each line of the 
detector being independent with respect to each other, we can 
focus our attention on one single spectral channel 1 , which is 
assumed here to be monochromatic. The effect of a spectral 
bandwidth on the interferometric equation is treated in Section 

EO 

1 In practice, there is a previous image centering step, where each 
channel is re-centered with respect to each other along the wavelength 
dimension, as explained in Sect. [5] 
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Interferometric output: when only the i' h beam is illumi- 
nated, the signal recorded in the interferometric channel is the 
photometric flux F' spread on the Airy pattern a',, that is the 
diffraction pattern of the ir output pupil weighted by the single 
mode of the fiber, k is the pixel number on the detector, a being 
the associated angular variable. F' results in the total source 
photon flux N attenuated by the total transmission of the i' h op- 
tical train t, i.e. the product of the optical throughput (including 
atmosphere and optical train of the VLTI and the instrument) 
and the coupling coefficient of the single mode fiber: 



F' = Nt 



(1) 



When beams i and j are illuminated simultaneously, the 
coherent addition of both beams results in an interferometric 
component superimposed to the photometric continuum. The 
interferometric part, that is the fringes, arises from the am- 
plitude modulation of the coherent flux F'J at the coding fre- 
quency pi . The coherent flux is the geometrical product of the 
photometric fluxes, weighted by the visibility: 



/•."'-2.V V^TVv""'"^ 



(2) 



where y u e l4) ' J is the complex modal visibility JMe^e et al.l 
120031) and <f>p takes into account a potential differential atmo- 
spheric piston. Note that strictly speaking the modal visibility 
is not the source visibility. However the study of the relation 
between the modal visibility and the source visibility is beyond 
the scope of this pa per, and further informat ions can be found in 

ge et alJ i2003h and lTatulli etaP 12QQA Here we consider 
our observable to be the complex modal visibility. 

Such an analysis can be done for each pair of beams arising 
from the interferometer. As a result, the interferogram recorded 
on the detector can be written in the general form: 




(3) 



(p' s J is the instrumental phase taking into account possible 
misalignment and/or differential phase between the beams a' k 
and al. C'g and <t>^ are respectively the loss of contrast and 
the phase shift due to polarization mismatch between the two 
beams (after the polarizers), as rotation of the single mode 
fibers might induce. This equation is governing the AMBER 
fringe pattern, that is the interferometric channel of the 
fourth column. The first sum in Eq. 0, which represents the 
continuum part of the interference pattern, is called from now 
on the DC component, and the second sum, which describes 
the high frequency part (that is the coded fringes), is called the 
AC component of the interferometric output. 

Photometric outputs: thanks to the photometric chan- 
nels, the number of photoevents p'(a) coming from each 
telescope can be estimated independently: 



F% 



(4) 



where b\ is the beam profile in the i th photometric channel. The 
previous equation rules the photometric channels. 



3. Data reduction algorithm 

The AMBER data reduction algorithm is based on the mod- 
elling of the interferogram in the detector plane. Such a method 
requires an accurate calibration of the instrument. 



3.1. Modelling the interferogram 

In order to model the interferogram, we discriminate between 
the astrophysical and instrumental parts in the interferometric 
equation. It comes 



Ntel 



(5) 



with 



c' J = C 

c k B 



d' J = C' J 

"k B 



J a', al 

jj y k k 



cos(27ra,/' 7 + 41 + &1) 



(6) 



(7) 



k a k a i 



and 



(8) 



As an analogy with telecom data processing, c' k J and d'J are 
called the carrying waves of the signal at the coding frequency 
/'■', since they carry (in terms of amplitude modulation) R'-> and 

which are directly linked to the complex coherent flux (as 
shown by Eq. (|8|i). 

The estimated photometric fluxes P' are computed from the 
photometric channels (see Eq. (0)): 



P^F^K 

k 



(9) 



If we know the ratio v' k -which depends only of the instrumen- 
tal configuration - between the measured photometric fluxes 
P' and the corresponding DC components of the interferogram, 
we can have an estimation of the latter thanks to the following 
formula: 



a' k F> 



P'v\ 



(10) 



We then can compute the DC continuum corrected interfero- 
gram nit: 



m k = ik 



N te , 



which can be rewritten: 



m k = c' k J R ij - dpi 



(11) 



(12) 
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Table 2. Acquisition sequence of calibration files 



Step 


Sh 1 


Sh2 


Sh3 


Phase 70 


DPR key 


1 


O 


X 


X 


NO 


2P2V, 3P2V 


2 


X 


o 


X 


NO 


2P2V, 3P2V 


3 


o 


o 


X 


NO 


2P2V, 3P2V 


4 


o 


o 


X 


YES 


2P2V, 3P2V 


5 


X 


X 


o 


NO 


3P2V 


6 


o 


X 


o 


NO 


3P2V 


7 


o 


X 


o 


YES 


3P2V 


8 


X 


o 


o 


NO 


3P2V 


9 


X 


o 


o 


YES 


3P2V 



Sh = Shutter; O = Open; X = Closed 



This equation defines a system of N P j X linear equations with 
2Nb = N, e i{N, e i - 1) unknowns (i.e. twice the number of base- 
lines). It characterizes the linear link between the pixels on the 
detector and the complex visibility: 



N,, 



' mi 1 
1 




, m N„„ ) 


\ 



d'l . ^ 



d' J 



( '■ ' 




f '■ \ 


R'J 








= V2PM 




I'j 




I'j 


\ '■ , 




■ , 



(13) 



The V2PM matrix (namely Visibility To Pixel Matrix), which 
contains the carrying waves, holds the information about the in- 
terferometric beams ^a'^, the coding frequencies f' and the 

instrumental differential phases <p'J . Together with the vJL they 
entirely describe the instrument from a signal processing point 
of view. These quantities, namely c'l, d'l and v' k have however 
to be calibrated. 

3.2. Calibration procedure 

The calibration procedure is performed thanks to an internal 
source locat ed in the Calibratio n and Alignment Unit (CAU) 
of AMBER JPetrov et alJbOOrJ) . It consists in acquiring a se- 
quence of high signal-to-noise ratio calibration files, which 
successive configurations are summarized in Table |2] and de- 
tailed below. Since the calibration is done in laboratory, the 
desired level of accuracy of the measurements is insured by 
choosing the appropriate integration time. As an example, typ- 
ical integrations time in "average accuracy" mode are (for the 
full calibration process) r = 17s, 30s, 800s for respectively 
low, medium and high spectral resolution modes in the K band, 
and 100 times higher for the "high accuracy" calibration mode. 

The sequence of calibration files has been chosen to ac- 
commodate both two and three-telescope operations. For a two- 
telescope operation, only the 4 first steps are needed. Raw data 
FITS files produced by the ESO instruments bear no identifi- 
able name and can only be identified as, e.g., files relevant to 
the calibration of the V2PM matrix, only by the presence of 
dedicated FITS keywords (ESO's pipeline Data PRoduct keys 
or "DPR keys") in their header. The DPR keys used are listed 
in Table |2 



First (steps 1 and 2 — and 5 when in 3-telescope mode), for 
each telescope beam, an image is recorded with only this shut- 
ter opened. The fraction of flux measured between the interfer- 
ometric channel and the illuminated photometric channel leads 
to an accurate estimation of the v\ functions. Then, in order to 
compute the carrying waves c'l and d'J, one needs to have two 
independent (in terms of algebra) measurements of the interfer- 
ogram since there are two unknowns (per baseline) to compute. 
The principle is the following: two shutters are opened simul- 
taneously (respectively steps 3/4, 6/7, and 8/9) and for each 
pair of beams, the interferogram is recorded on the detector. 
Such an interferogram corrected from its DC component and 
calibrated by the photometry yields the knowledge of the c k 
carrying wave. To obtain its quadratic counterpart, the previ- 
ous procedure is repeated by introducing a known phase shift 
close to 90 degree jo using piezoelectric mirrors at the entrance 
of beams 2 and 3. Computing the d'l function from the knowl- 
edge of c'l and jq is straightforward. Note that by construction: 
(i) the carrying waves are computed with the unknown system 
phase <E> C (possible phase of the internal source, differential op- 
tical path difference introduced at the CAU level, etc.), and 
that; (ii) since the internal source in the CAU is slightly re- 
solved by the largest baseline (1-3) of the output pupils, the 
carrying waves for this specific baseline are weighted by the 
visibility V c of the internal source. Hence at this point, the car- 
rying waves are following expressions slightly different from 
their original definition given by Eq.'s l|6) and (0: 



a k a k 



d' J = 



4 



■C'^Vl cos(2na k fj + + <D^ + d>' c J ) 



a' k a' k 



k a 'k a k 



C' J V' 



(14) 



(15) 



However, since c'l 
following relation: 



and d'l 



4 = C;v; 



are shifted by 7r/2, they insure the 



(16) 



Hence the conjugated loss of visibility due to the internal 
source and the polarization effects can be known and cali- 
brated 1 by computing previous formula. Unfortunately, since 
it is not possible to disentangle between both contrast losses, 
and since the V c factor only affects the interferograms arising 
from the calibration procedure, and not from the observation, 
the visibility estimated on a star will be affected from this factor 
as well, as shown in Section l3.5.1l 

Figure [3] illustrates Eq. [H)] For the baselines (1,2) and 
(2, 3), the contrast loss arises from polarization effects since the 
internal source is unresolved. We find respectively C^ 2 ^ 0.9, 
and C^ 3 ^ 0.8. For the third baseline (1,3), the internal source 
is partially resolved, which explain an higher contrast loss, 
C^V 1 , 3 = 0.7. 



1 This step is not yet provided in the amdlib software described in 
Sect.|4| 
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vk functions - 2200nm Calibration matrix - 2200nm ck & dk functions _ 2200nm 




#pixels 2 4 6 #pixels 



Fig. 2. Outputs of the calibration procedures. Examples have been chosen for one given wavelength: A = 2.2/j.m. Left: the v\ 
functions. Middle: the matrix containing the carrying waves, the first three columns are the cl functions for each baseline, and 
the three last columns are the respective d'l functions. One can see that for each baseline cl and d'l are in quadrature. Right: 
another representation of the carrying waves. From top to bottom, both sinusoidal functions correspond respectively to columns 
1 - 4, 2 - 5 and 3 - 6 of the calibration matrix. 



3.3. Fringe fitting 

To estimate the coherent fluxes and /' ; which are at the basis 
of the computation of the whole AMBER observables, one has 
to solve the inverse problem described by Eq. Hit , that is one 
has to perform a x 2 linear fit of the fringes, with the coherent 
fluxes being the unknown parameters. The solution is given by 
the following equation: 

[R ij J' J ] = P2VM[m k ] (17) 
where 

P2VM = [ V2PM r C M 1 V2PM] " 1 V2PM 7 C M 1 (18) 

is the generalized inverse of the V2PM matrix, Cm being the 
covariance matrix of the measurements m k , and X T denoting 
the transpose of the X matrix. P2VM means Pixel to Visibility 
Matrix since it allows to estimate the complex visibility from 
the interferogram recorded on the detector. Assuming that the 
pixels on the detector are uncorrected, the Cm matrix is di- 
agonal, with each term of the diagonal being defined by the 
variance of the DC corrected interferogram cr 2 (m k ). The funda- 
mental error on the DC corrected interferogram arises from the 
photon noise and detector noise (of variance <x) corrupting the 
measurements, that is each pixel of the interferogram i k , and 
the estimated photometric fluxes P' . It comes: 

N, e , _ 

o-\m k ) = i k + a 2 + Yj [ p i + N P i,o- 2 ] W k ) 2 (19) 

3.4. Fringe detection 

Positive detection of fringes in the measurements requires at 
the same time enough flux entering the fibers and high enough 
fringe contrast, so that the fringes rise of the noise level. As a 
result, the computation of the signal to noise ratio of the co- 



herent flux, which takes into account both of the parameters, 
appears naturally as the relevant criterion to use. It writes: 

MAT, £ 44 < I { a% JP 

b being for sake of simplicity the baseline number which de- 
scribes each couple of telescopes (z, J), Nb being the number 
of baselines, and Ni being the number of spectral channels. In 
absence of fringes, the quantities R h2 and I h2 are tending to- 
ward cr 2 Rb and crj b respectively, thus driving the fringe criterion 
toward 0. At the opposite, the presence of fringes above the 
noise level, that is when R h2 (l, f) > cr 2 Rb and/or I b2 (l, t) > cr 2 b 
imposes the fringe criterion to be strictly superior to and is 
directly linked to the quality of the frames. It thus allows to 
operate a fringe selection prior to the proper estimation of the 
observables, which step can be useful for sets of data recorded 
in bad observational conditions, as shown in Section l5^2l 

cr 2 Rb and cr 2 b , that is the bias part of respectively R 2 and I 2 , 
can be easily computed from the definition of the real and imag- 
inary part of the coherent fluxes, which are linear combinations 
of the DC continuum corrected interferograms m k . If ( b and 
are the coefficient of the P2VM matrix, R h and /* verify the 
respective following equations: 

N pix N pix 

R b = J]( b k m k , I b = J]e k m k (21) 

k=\ k=\ 

It comes straightforward that: 

<A» = Yjtt b k) 2 v 2 (m k ); ,7* = ^(^)V(m*) (22) 

k k 

3.5. Estimation of the observables 

For each spectral channel, squared visibility and closure phase 
(in the three telescope case) can be estimated from the interfer- 
ogram. Taking advantage of the spectral dispersion, differential 
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Fig. 3. Contrast loss due to polarization effects and partial res- 
olution of the internal source, as a function of the wavelength. 
The 3-telescope P2VM used is the same than the one presented 
in Fig. [3 The errors bars are roughly at the level of the contrast 
loss rms along the wavelength. In other words, the contrast loss 
is constant over the wavelength range. 



phase can be computed as well. In the following paragraphs, we 
denote with (...) the ensemble average of the different quanti- 
ties. This average can be performed either on the frames within 
an exposure and/or on the wavelengths. 



3.5.1 . The squared visibility 

Theoretically speaking, the squared visibility is given by com- 
puting the ratio between the squared coherent flux and the pho- 
tometric fluxes. Following Eq.'s Q, (0, © and it comes: 



\F'c 



>J\2 



R'J- + I'J 



4F'FJ AP'Pi^tvW. y; 



(23) 



Note that, thanks to the calibration process, the computed vis- 
ibility is free from the instrumental contrast, that is the loss of 
contrast due to the instrument, but as mentioned in Section l3~2l 

the object visibility is weighted by the visibility of the inter- 
im 

nal source. However this factor (Vy ) automatically disappears 
when doing the necessary atmospheric calibration (see Section 

As a result the visibility - atmospheric issues apart - has 
still to be calibrated by observing a reference source. 

In practice, because data are noisy, we perform an ensemble 
average on the frames that compose the data cube (see Section 
I2.1> to estimate the expected values of the square coherent flux 
and the photometric fluxes, respectively. Taking the average 
of the squared modulus of the coherent flux, that is doing a 
quadratic estimation, allows to handle the problem of the ran- 
dom differential piston <pp, but introduces a quadratic bia s due 
to the zero-mean photon and detector noises JPerrinl2003l) . The 
expression of the squared visibility estimator, unbiased by fun- 
damental noises is therefore: 



[^Jp (R'J 2 + pfl\ - Bias{/^' 2 + Pi 2 



4 Z*V t v t 



(24) 



The quadratic bias of the squared amplitude of the coherent flux 
writes as the quadratic sum of the biases of R 2 and I 2 . From Eq. 
|2~2"1 it comes: 



Bias{R ij2 + I tj2 } 



=Z[(4 J ) 2 +(€) 2 F(-*) 



(25) 



Previous equation is nothing but the mathematical expression 
that describes the bias as the quadratic sum of the errors of the 
measurements cr 2 (m/.) (as defined by Eq. dl9». projected on the 
real and imaginary axis of the coherent flux. 

Using the squared visibility estimator of Eq. J24i . the 
theoretical error bars on the squared visibilit y can be com- 
puted from its secon d order Taylor expansion JPapoulislll984 
iKervella et al.l2004 : 



<T 2 (\V ij \ 2 ) 



1 

M 



(r 2 (\C ij \ 2 ) + q- 2 (P'P-Q 



\Cij\ 2 



pipj 



\yiJ\2 



(26) 



where \C iJ \ 2 = R ij + I ij - Bias)^ 1 -' + PJ } is the unbi- 
ased squared coherent flux. In practice, the expected value and 
the variance of the squared coherent flux and the photometric 
fluxes are computed empirically from the M available measure- 
ments. It comes the following semi-empirical formula: 



(\c iJ \ 4 ) M - 



(P' 2 PJ 2 \ - (pipj) 



M 



(27) 



Note finally that, although quadratic estimation of the vis- 
ibility has been computed, the squared visibility will be sys- 
tematically decreased by the atmosphere jitter during the frame 
integration time. We focus on this effect in Sect. 13.61 

3.5.2. The closure phase 

By definition, the closure phase is the phase of the so-called 
bispectrum B 123 . The latter results on the ensemble average of 
the coherent flux triple product and then estimated as follows: 



B 



123 



[2 C 23 C 1J 



where C lJ 
forward: 

— 123 

<pB = atan 



) (28) 
R'j + iPi. The closure phase then comes straight- 



lm{B l2i ) 



Re(B 12J ) 



(29) 



The closure phase pres ents the advant age to be independent 
of the atmosphere (e.g. iRoddieJ Jl986l) V However in the case 
of AMBER, the closure phase of the image might not coin- 
cide with the one of the object and might be biased because of 
the calibration process. If the so-called system phase presents 
an non zero closure phase O' 2 + O 23 - <t>' 3 , this bias must 
be calibrated by observing a point source or at least a centro- 
symmetrical object. So far, no theoretical computation of the 
error of the closure phase has been provided for the AMBER 
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data reduction algorithm. Thus, closure phases internal error 
bars (i.e. that does not include systematics errors) are computed 
statistically, that is by taking the root mean square of all the in- 
dividual frames, then divided by the square root of the number 
of frames, as it is illustrated in Section l5~5l 

3.5.3. The differential phase 

The differential phase is the phase of the so-called cross spec- 
trum W\2- For each baseline, the latter is estimated from the 
complex coherent flux taken at two different wavelengths A\ 
and A%: 



W' J 



And the differential phase is: 
Im(wg)" 



atan 



Re 



K) 



(30) 



(31) 



3.5.4. The piston 

The interferometric phase induced by the achromatic piston 
term takes the form: 



2jt6' j 



= 2n6 ij (T 



(32) 



where <5' 7 is the achromatic differential piston between tele- 
scope i and j, A is the wavelength and <x is the wavenumber 
(i.e. cr = I /A). 

First order Taylor expansion: At first order, the estimated dif- 
ferential phase of Eq. ( 13 11 is a linear function which takes the 
generic form A0i2 = <p\ + 2n (o"2 - <T\) 5. Its slope 5 depends of 
the sum of atmospheric piston 6 P which varies frame by frame, 
and of the linear component of the object differential phase 6 . 
A good estimate of this slope in presence of noise is the argu- 
ment of the average cross spectrum along the wavelengths: 



"p 



~ arg 
+ <# = 



2tt(o-a 2M -o- All ), 



(33) 



The estimation of the piston is unbiased when the wave num- 
ber varies linearly with the spectral pixel index (linear grat- 
ing dispersion law). This can be true with an excellent ap- 
proximation at Medium Spectral Resolution and High Spectral 
Resolution in the AMBER case. However, for the Low Spectral 
Resolution, biases as high as 5% in the estimation of piston can 
occur. 

Fitting the complex phasor: The achromatic piston can also 
be estimated from a least square fit of the complex coherent 
flux. If we define the complex phasor as: 



¥ A = C xe- 



(34) 



d'-i can be retrieved by minimizing the phase of such complex 
phasor, or equivalently by minimizing the tangent of the phase. 
The^ 2 is then defined as: 



z 



( Im(<¥ A ) y 

cr 2 , + cr? 



x~ 



z 



(35) 



4, + °~l 



This x 2 is highly non-linear and simple techniques as gradient 
fitting cannot be used here. On the contrary, non-linear fitting 
techniqu es such as gene tic or simulated annealing algorithms 
jKirkpatricketal.ll 9831) must be used instead. 

Note that, in order to disentangle between the atmospheric 
piston dp and the linear component of the differential phase 5 , 
the fitting techniques described above can be performed only 
using spectral channels corresponding to the continuum of the 
source (i.e. outside spectral features), that is where its differen- 
tial phase of the object is assumed to be zero. 

3.6. Biases of the visibility 

3.6.1 . Loss of spectral coherence 

The above derivation of the interferometric equation assumes a 
monochromatic spectral channel. In practice the spectral width 
of one spectral channel is non zero and depends on the reso- 
lution % of the spectrograph. As a consequence the coherence 
length £ c of the interferogram is finite and equals £ c = ArfR. 
where A® is the reference wavelength in the spectral channel. 
Assuming a linear decomposition of the phase of the interfero- 
gram and neglecting higher orders, the interferogram is attenu- 
ated by a factor pk, which can be written: 



Pk = 



— / 6k + 5 p +6 



(36) 



where T is the Fourier transform of the spectral filter func- 
tion. 5k is the spatial sampling of the interferogram, that is the 
pixel coordinates expressed in optical path difference (OPD) 
units, dp and 5 being respectively the atmospheric piston and 
the slope of the object spectral differential phase, as defined in 
Sect. I3.5.4I Note that for a square filter, the attenuation coeffi- 
cient takes the well known form of the sine function: 



Pk 



h + 6 P + 6 

' To 



(37) 



In the low resolution mode where ft - 35, the attenuation co- 
efficient severely depends on the pixel position 5k which is cal- 
ibratable quantity. Nonetheless, the compensation of this effect 
requires an iterative process in two steps where (i) the estima- 
tion of dp + S is performed as described in Section l3.5.4l and 
(ii) the pk attenuation correction is applied directly to the DC 
corrected interferograms m^. The loop is then repeated until 
convergence. This algorithm, which not yet implemented in the 
software, will be described in greater details in a further paper. 

In the medium and high resolution (where respectively 
n = 1500 and % = 10000) however, the OPD 5 k due the spatial 
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sampling of AMBER can be neglected. Indeed this approxima- 
tion drives to a relative error of the coefficient below 10~ 3 and 
10~ 5 respectively, that is within the specified error bars of the 
visibility. In such a case, the loss of spectral coherence sim- 
ply results in biasing frame to frame the visibility by a factor 
p(5 p + 5,,). This bias can be corrected by knowing the shape of 
the spectral filter and by estimating the piston 6 P + S,, thanks to 
Eq. 03- 

3.6.2. Atmospheric jitter 

Although a quadratic estimation of the visibility has been per- 
formed to avoid the differential piston to completely cancel out 
the fringes, the high frequency variations of the latter during 
the integration time - so called high-pass jitter - nevertheless 
blur the fringes. As a result, the coherent flux, hence the visi- 
bility, is attenuated. In average, t he attenuation co efficient T of 
the squared visibility is given bv lColavital lll 999bh : 

T = expi-a 2 ) (38) 

"*/ 

where a 2 ^, is the variance of the high-pass jitter (p 1 ^. 

For the time being, this atmospheric effect is compensated 
by calibrating the source visibility with a reference source ob- 
served shortly before and after the scientific target to insure 
similar atmospheric conditions. We have also planned to pro- 
vide in the near future a more accurate calibration of this effect, 
based on the computation of the variance of the so-called "first 
difference phase jitter", that is the difference of the average pis- 
ton taken betwee n two successive exposures, as proposed by 
IColavital Jl999bl) for the PTI i nterferometer and successfully 
applied bv lMalbet etail dl998h . However, jitter analysis (as it 
is illustrated in Section l5~2l cannot be tested and validated as 
long as the extra-sources of vibrations due to VLTI instabilities 
(delay lines, adaptive optics...), hardly calibratable, are clearly 
identified and suppressed. N ote as well that t he use of the accu- 
rate fringe tracker FINITO Jr,ai et al]l20ol . soon expected to 
operate on the VLTI, should drastically reduce the jitter atten- 
uation, hence allowing to integrate on times much longer than 
the coherence time of the atmosphere in order to reach fainter 
stars. 

4. The amdlib data reduction software 

A dedicated software to reduce AMBER observations has 
been developed by the AMBER consortium. This consists in 
a library of C functions, called amdlib, plus high-level inter- 
face programs. The amdlib functions are used at all stages of 
AMBER data acquisition and reduction: in the Observation 
Software (OS) for wavelength calibration and fringe acquisi- 
tion, in the (quasi) Real Time Display program used during the 
observations, in the online Data Reduction Pipeline custom- 
ary for ESO instruments, and in various offline front end ap- 
plications, noticeably a Yorick implementation (AmmYorick). 
The amdlib library is meant to incorporate all the expertise 
on AMBER data reduction and calibration acquired through- 
out the life of the instrument, bound to evolve with time. 



The data obtained with AMBER ("raw data") consist in an 
exposure, i.e., a time series of frames read on the infrared cam- 
era, plus all relevant information from AMBER sensors, ob- 
served object, VLTI setup, etc., stored in FITS TABLE format, 
according to ESO interface document VLT-ICD-ESO- 15000- 
1826. Saving the raw, uncalibrated data, although more space 
consuming, permits to benefit afterward, by replaying the cal- 
ibration sequences and the data reduction anew, of all the im- 
provements that could have been deposited in amdlib in the 
meantime. 

The library contains a set of "software filters" that refine the 
raw data sets to obtain calibrated "science data frames". This 
treatment is performed on every raw data frames, irrespective 
of their future use (calibration or observation). A second set of 
functions perform high level data extraction on these calibrated 
frames, either to compute the V2PM (see Sect. 14. 3> from a set 
of calibration data, or to extract the visibilities from a set of 
science target observations, the end product in this case being 
a reduced set of visibilities per object, stored in the optic al in- 
terferometry standard OI_FITS format dPauls et al.l2005l) . 

4. 1 . Detector calibration 

First, all frames pixels are tagged valid if not present in the 
currently available bad pixel list of the AMBER detector. Then 
they are converted to photoevent counts. This step necessitates, 
for each frame, to model precisely the spatially and temporar- 
ily variable bias added by the electronics. The detector exhibits 
a pixel-to-pixel (high frequency) bias whose pattern is constant 
in time but depends on the detector integration time (DIT) and 
the size and location of the subwindows read on the detector. 
Thus, after each change in the detector setup, a new pixel bias 
map (PBM) is measured prior to the observations by averag- 
ing a large number of frames acquired with the detector fac- 
ing a cold shutter 2 . This PBM is then simply removed from all 
frames prior to any other treatment. 

Once this fixed pattern has been removed, the detector may 
still be affected by a time-variable "line" bias, i.e., a variable 
offset for each detector line. This bias is estimated for each scan 
line and each frame as the mean value of the corresponding 
line of masked pixels ("DK" column in Fig.^, and substracted 
from the rest of the line of pixels. The detector has an image 
persistence of ~ 10%, consequently all frames are corrected 
from this effect before calibration. Pixels are then converted to 
photoevent counts by multiplying by the pixel's gain. Currently 
the map of the pixels gains used is simply a constant e~ /ADU 
value (see Table Q multiplied by a "flat field" map acquired 
during laboratory tests. 

Finally, the rms of the values in the masked pixel set, that 
were calibrated as the rest of the detector, gives the frame's 
detector noise. 

2 Due to mechanical overheads, "hot dark" observations, i.e., using 
only an ambient temperature beam shutter external to the dewar of the 
detector, are currently used to compute the PBM. 
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4.2. Image alignment and science data production 

Once the cosmetics on the pixels is done, amdlib corrects the 
data from the spatial distortions present in the image. Presently, 
the only effect corrected is a displacement of the spectra ac- 
quired in the "photometric channels" (labeled PI, P2, P3 in 
Fig. [0 with regards to the fringed spectrum in the interfero- 
metric channel. This displacement, of a few pixels in the spec- 
tral dispersion direction, is due to a slight misalignment of the 
beam-splitters described in Sect. 12.11 and correcting from this 
effect is mandatory to compute the DC continuum interfero- 
gram (Eq. il 1» . The calibration of this displacement is per- 
formed by amdlib during the spectral calibration procedure, 
one of the first calibration sequences to be performed prior to 
observations. 

Finally, each frame is converted to the more handy "science 
data" structure, that contains only the calibrated image of the 
"interferometric channel" and (up to) three ID vectors, the cor- 
responding instantaneous photometry of each beam, corrected 
from the above mentioned spectral displacement. 

4.3. Calibration matrix computation 

The computation of the V2PM matrix is performed by the func- 
tion aradlibCoraputeP2vm(). This function processes the 4 or 
9 files described in Sect. 13.21 applying on each of them the de- 
tector calibration, image alignment and conversion to "science 
data" described above, then computing the v\ (Eq. i ll Oi l) and the 
carrying waves c'^ and d l l of the V2PM matrix (Eq. dl3» . The 
result is stored in a FITS file, improperly called, for historical 
reasons, "the P2VM" 3 . 

The P2VM matrix is the most important set of calibration 
values needed to retrieve visibilities. The shape of the carrying 
waves (the qs and d^s ) and in a lesser measure the associated 
v^s, are the imprints of all the changes in intensity and phase 
that the beams suffer between the output of each fiber and the 
detection on the infrared camera. Any change in the AMBER 
optics situated in this zone, either by moving, e.g., a grating, 
or just thermal long-term effects, render the P2VM unusable. 
Thus, the P2VM matrix must be recalibrated each time a new 
spectral setup is called that involves changing the optical path 
behind the fibers. 

All the instrument observing strategies and operation are 
governed by the need to avoid unnecessary optical changes, 
and care is taken at the operating system level to insure a recal- 
ibration of the P2VM whenever a "critical" motor affecting the 
optical path is set in action. To satisfy these needs, the P2VM 
computation has been made mandatory prior to science obser- 
vations, and is given an unique ID number. All the science data 
files produced after the P2VM file inherit of this ID, that as- 
sociates them with their "governing" calibration matrix. The 
amdlib library takes the opportunity that the P2VM file is piv- 
otal to the data reduction, and unique, to make it a placeholder 
of all the other calibration tables needed to reduce the science 
data, namely the spectral calibration, bad pixels and flat field 
tables. 

3 Whereas "the V2PM" should be the proper name. 



4.4. From science data to visibilities 

The computation of visibilities is performed by the 
amdlibExtractVisibilitiesO function, using a valid 
P2VM file. amdlibExtractVisibilitiesO is able to 
perform visibility estimates on a frame-by-frame basis, or over 
a group of frames, called bin. 

The amdlibExtractVisibilitiesO function, in se- 
quence: 

1. invert the V2PM calibration matrix; 

2. extract Raw Visibilities; 

3. correct from Biases, compute debiased V 2 visibilities, 

4. compute Phase Closures, 

5. compute Cross Spectra 

6. fit Piston values from cross spectra 

7. write the OI-FITS output file. 

A typical data reduction process will first process all 
raw data files related to the calibration procedures per- 
formed before acquiring the science data, thus perform- 
ing spectral calibration (e.g., using the command line pro- 
gram amdlibComputeSpectralCalibration), then P2VM 
file computation (e.g., using the command line pro- 
gram amdlibComputeP2vm). Once the P2VM file is com- 
puted, it contains all the calibration quantities necessary 
to process science object observations. One then uses the 
amdlibExtractVis program on a science data set to get the 
final OI-FITS file containing the measured science object visi- 
bilities. 

5. Illustrations and discussions 

This section aims to present step by step the data reduction pro- 
cedures performed on real interferometric measurements aris- 
ing from VLTI observations. Results are discussed, focusing on 
key points of the process. 

5.1. Fringe fitting 

Assuming the calibration process has been properly performed 
following Section l3~2l the first step in the derivation of the ob- 
servables is to estimate the real and imaginary part of the coher- 
ent flux. This is done by inverting the calibration matrix and ob- 
taining the P2VM matrix, shown by Eq.'s dl7> and (II 8L Figure 
Ogives an example of the fringe fitting process, for an observa- 
tion of the calibrator star HD135382 with three telescopes. 

However, before going further in the data reduction pro- 
cess, it might be worthwhile for the users to check the validity 
of the fit and then to detect any potential problems in the data. 
Such step can be easily done by computing the residual %j es 
between the measurements m^ and the model rhk'. 

[m] = V2PM[R ij J ,j ] (39) 

and 

X 2 res = P"* - m k ] T C^ [m k - m t ] (40) 

Using this checking procedure, the user can verify two critical 
points of the data processing: 
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Fig. 4. Example of fringe-fitting by the carrying waves, in the 
3 telescope case. The DC corrected interferogram is plotted 
(dashdot line) with the error bars. The result of the fit is over- 
plotted (solid line). 



- the correct subtraction of the DC component (see Eq. il 

if such a condition is not fulfilled, the computed visibility 
will inevitably be biased since the fringe fitting by the car- 
rying waves supposes the only presence of specific frequen- 
cies, that is the spatial coding frequencies of the instrument. 
A wrong DC subtraction might occur with sudden atmo- 
spheric changes between the recording of the interferomet- 
ric channel and the associated photometric ones, as these 
channels are not on the same line of the detector, as men- 
tioned in Section l4~2l 

- the use of a correct bad pixel map: if not, the presence of 
bad pixels induces high frequencies in the fringes which 
cannot be taken into account by the carrying waves, driv- 
ing to compute biased visibility as well. Note that the bad 
pixel map is computed every time detector calibration is 
performed in the maintenance procedure. 

5.2. Fringe criterion and fringe selection 

For each frame of the set of data, Eq. J20i provides an estima- 
tion of the fringe Signal to Noise Ratio. As an example, Figure 
[5] presents 100 fringes recorded on the detector during the 2- 
telescope observation of the calibrator e Sco in July 2005, first 
in the order as they appeared during the observation and then 
after re-ordering them following the fringe criterion. 

The aim of computing this criterion can be twofold: (i) dur- 
ing the observations, as mentioned in Section |3~31 it allows to 
detect the fringes and therefore to initiate the recording of the 
data only when it is meaningful and; (ii) calculated a poste- 
riori during the data reduction phase, it enables to select the 
best frames (in terms of SNR) before estimating the observ- 
ables. This second point is especially important where frames 
are recorded in presence of strong and variable fringe jitter. 

In the ideal and unrealistic case where the fringes are not 
moving during the integration time, the fringe contrast is not 
attenuated by vibrations, and the frame by frame estimated vis- 
ibility is constant, no matter the photometric flux level in each 
arm of the interferometer. As a result, the visibility as a func- 



tion the function of the fringe SNR is constant, with the er- 
ror bars increasing as the fringe SNR decreases. This is illus- 
trated in Figure|6](left). To obtain this set of jitter-free data, we 
have built interferograms using the carrying waves of the cal- 
ibration matrix that simulate perfectly stable AMBER fringes. 
Then, we have added the photometry taken on the e Sco data 
which allowed us to keep realistic photometric realizations tak- 
ing into account the correct transmissions of the instrument. In 
that case, selecting the best fringes has no other ambition than 
improving the SNR on the observables by excluding the data 
with poor flux. 

If the presence of atmospheric turbulence and without 
fringe tracker, the fringes are moving during the integration 
time, driving to lower the visibility. In average, the squared 
visibility is attenuated by a factor exp(-cr^, ), where cr\ is 

the variance of the atmospheric high pass jitter, as explained in 
Section l3.6.2l The frame by frame visibility though, undergoes 
a random attenuation around this average loss of contrast. An 
example of the effect of the atmospheric jitter is given on Fig. [6] 
(middle), where previous set of simulated data has been used, 
with adding a frame by frame random attenuation taking into 
account the t = 25ms integration time of the e Sco observation. 
Once again, fringe selection only enables here to increase the 
SNR of the observables. 

However, when we look at the real set of data obtained from 
the observation of e Sco, we obtain the plot displayed on Fig. 
|6] (right). The dispersion of the visibility, especially for low 
fringe SNR is unexpectedly large and can definitively not be 
explained by pure atmospheric OPD vibrations. As a matter of 
fact, these variations are due to the present strong vibrations 
along the VLTI instrumentation (adaptive optics, delay lines, 
. . .), as this effect was previously revealed by the VINCI recom- 
biner. These vibrations strongly reduce the fringe contrast and 
subsequently the value of the estimated visibilities, which ex- 
plains the behavior of the visibilities as a function of the fringe 
SNR. Indeed, when the visibility tends toward 0, because of 
severe jitter attenuation, the fringe criterion tends toward as 
well. On the contrary, the visibility plotted as a function of the 
fringe SNR saturates for high values of the latter. 

The major issue is that such an effect is hardly calibratable 
because potentially non stationary. Hence, one convenient way 
to overcome the problem, beside increasing artificially the er- 
ror bars to take into account this phenomena, is to only select 
the fringes which are the less affected by the vibrations, that is 
the fringes with the highest fringe SNR. One can then choose 
the percentage of selected frames from which the visibility will 
be estimated. The threshold must be chosen according to the 
following trade-off: reducing the number of accounted frames 
allows to get rid of most of the jitter attenuation, but, from a cer- 
tain number - when the sample is not large enough to perform 
statistics -, it increases the noise on the visibility. Furthermore, 
it leads to mis-estimate the quadratic bias (see Eq. i25\ ). which 
is by essence a statistical quantity, and consequently drives to 
introduce a bias in the visibility. 

Obviously, such a selection process must be handled with 
care, and its robustness with regard to the selection level has 
to be established for any given observation. In other words, 
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Fig. 5. Left: sample of 100 successive interferograms as recorded during the observation with two telescope of e Sco in the low 
spectral resolution mode. Right: Re-ordering of this sample using the fringe SNR criterion (from left to right, bottom to top). 
Note that, some frames which are on the bottom of the right panel (that is with relatively low SNR) appear to be brighter than 
some above them (that is the flux is higher). However these frames do not exhibit fringes, which explains their positions. 





100 150 

Fringe SNR 




Fringe SNR 



Fig. 6. Visibility as a function of the fringe SNR criterion. Left: for jitter- free simulated data, using the real photometry observed 
on e Sco. The fringe contrast was set to 1. Middle: Same as previous one, but atmospheric jitter attenuation has been added, 
corresponding to a integration time of t = 25ms. Right: Real e Sco observation. The encircled data point on the plot, well above 
the other ones, is typical of a bad fit of the associated fringe, as explained in Section l5~T1 Note that in the first two cases, the 
maximum of the fringe SNR is higher than in the real case. Indeed, in the simulated data, the noise on the coherent flux only 
arises from the photometry P' . In the real case, however it depends as well on the noise on the interferograms i$ (see Eq. H9\ ). 



for this method to be valid, the calibrated visibility expected 
value must remain the same, with only the error bars changing 
and eventually reaching a minimum at some specific selection 
level. In particular, this method seems well adapted above all 
to cases where the calibrator exhibits a magnitude close to the 
source's one, where a similar behavior of the visibility distribu- 
tion versus the SNR is expected. Going in further details of this 
point is nevertheless b eyond the scope of this paper as it will 
be deeply developed in lMillour et aljHoOfil) . However note that 
we experimentally found this procedure to be generally robust, 
and that for typical observations performed until now with the 
VLTI, choosing 20% of the frames as the final sample appeared 
to be a good compromise. 

Note that, in order to produce the curve of Fig. [6] visibil- 
ities have been computed frame by frame (i.e. M — 1). Thus, 
the semi-empirical calculation of the error bars given below in 



Section 1531 does not work, and one has to use a full theoret- 
ical e xpression of t he no ise. From an analysis in the Fourier 
space, IPetrov et alJ J2003h showed that the theoretical error on 
the frame by frame visibility could be written: 

'' - n' + N^o 2 



<r 2 (V' 7 ) = 



(41) 



where n'(t) = 2V™ vLPff) is the total flux in the i' h beam. This 
computation is not fully adapted to the AMBER data process- 
ing using 3 telescopes since in that case the Fourier peaks are 
overlapping. Nevertheless, it gives a rough estimation of the 
noise level, within a factor of 2, which is sufficient for the anal- 
ysis discussed here. 

Finally, despite that fringe selection has been performed to 
deal at best with the uncalibratable VLTI vibrations, the dis- 
persion of the selected visibilities has still to be quadratically 
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Fig. 7. Estimation of the raw squared visibility and its error- 
bars as a function of the wavelength for the observed calibra- 
tor e Sco, in low resolution mode. Visibility crosses and corre- 
sponding errors bars are computed thanks to Eq. i24l and Eq. 
( 1271 respectively. Circles and corresponding errors bars arise 
from bootstrapping technique. For sake of clarity, visibilities 
have been slightly shifted to the right and to the left of the cor- 
responding wavelengths, respectively. 



added to the error bar arising from the fundamental noises (as 
computed in section l53t . in order to account for the reminis- 
cent jitter attenuation, this latter having been reduced but not 
totally canceled out. 

5.3. Visibilities and associated errors 

The raw squared visibility (that is biased by the atmosphere) 
and its associated error bar are estimated from the ensemble 
average of M exposures, using Eq. i24\ and i21l respectively. 
Figure gives an example of the computed squared visibility 
in the low resolution mode, arising from the observation of the 
calibrator e Sco. For the example considered above, we find 
V 2 = 0.2721 + 0.0152, after averaging the spectrally dispersed 
visibilities. 

In order to validate the c omputation of the error ba rs, we 
use bootstrapping techniques fefron & Tibshiranil 19931) . Such 
a method, by making sampling with replacement, constructs a 
large population of N elements (N estimated squared visibil- 
ity) from the original measurements (M coherent and photo- 
metric fluxes). If N is large enough, the statistical parameters, 
that is the mean value and the dispersion of this population 
are converging respectively toward the expected value and the 
root mean square of the estimated parameters. N being large 
enough, these quantities can be calculated by fitting a Gaussian 
distribution p(V 2 ) to the histogram of the bootstrapped popula- 
tion. Figure[8]give an example of the histogram and the result- 
ing Gaussian fit. Using this method with N = 500, we find for 
the same set of data V 1 = 0.27 19 ±0.0149, which is in excellent 
agreement with previous computation. 

Note that, although we observed this object in the low res- 
olution mode, that at reasonably high flux, we find a relative 
error of the order of 6%. Such a quite large error bar is due 
to the atmospheric and intrumental jitter that, in the absence 




Fig. 8. Histogram of the bootstrapped population of estimated 
squared visibilities for a given wavelength. The fit of this his- 
togram by a Gaussian function is superimposed. The mean 
value and the root mean square of the Gaussian distribution 
gives the statistics of the estimated visibility. 



of fringe tracking, prevents to integrate time longer than a few 
tenth of milliseconds. When this latter device will be we expect 
to lower this error below the 1% level, till 0.01% f or the bright- 
est ca s es (assuming perfec t fringe tracking, see iMalbet et alJ 
dl998h : IPetrov et al.l (120061) '). But it is not possible to achieve 
AMBER's ultimate performances at that time. 

5.4. Notion of instrumental contrast in AMBER 

Given the calibration of the instrument described in Section 
13.21 and its subsequent use for the estimation of the visibility 
in Section l3.5.1l the instrumental contrast of AMBER is self 
calibrated. In other words, the response of the AMBER/VLTI 
instrument to the observation of a point source - in absence of 
atmospheric turbulence - does not depend on the instrumental 
contrast but only on the visibility of the internal source (see. Eq. 
d24» . Thus, if one wants to characterize the instrumental con- 
trast, that is the total loss of contrast due to the instrumentation, 
one needs to use another estimator in which the calibration part 
(the use of the knowledge of the instrument characteristics) is 
skipped. We thus can use the classical definition of contrast 
in the image plane, directly measured "by eyes" from the in- 
terferograms i^, recorded pair by pair of telescopes (as for the 
computation of the carrying waves). In spatial coding, this can 
be done for each pixel of the interferogram. Using Eq. (0 and 
Eq. J10I . it comes: 



C' r J 



C' J 

B 



— 7 

N ■ ^ 

1 " mx 



pi* — p% + Ph'i 



(42) 



Such an equation says that the instrumental contrast loss de- 
pends on two separate effects: (i) the polarization mismatch be- 
tween the beams after the polarizers (vectorial effect) and; (ii) 
the misalignment of the interfering beams (taken into account 
in the product v' k v J k ) together with the photometric unbalance 
between the two beams (scalar effect). Both effects are com- 
pensated when computing the visibility from the P2VM. 
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Fig. 9. Example of differential phases and closure phase com- 
putation on an observed o bject with a rotating fe ature in the Bry 
emission line (a Arae, see lMeilland et al.|d2006l) for a complete 
description and interpretation of these phases). 



5.5. Closure phase 

In the current situation, closure phases are computed using the 
estimator of Eq. (I28> . but a previous frame selection is per- 
formed before making the ensemble average of the bispectrum, 
because in all the data available there was a very low amount 
of frames which present simultaneously three fringe patterns. 
We have chosen an empirical selection criterion as the product 
of the three individual fringe SNR criteria (as defined by Eq. 
i20\ ). Closure phases internal error bars are computed statisti- 
cally, taking the root mean square of all the individual frames 
divided by the square root of the number of frames (assuming 
statistical independence of the frames), since the tested theo- 
retical error bars estimations does not give satisfactory results 
up to now. 

An example of closure phase and closure phase error bars 
is given in the figure[9] The object is a Arae which contains a 
rotating feature in the Bry emission line jMeilland et alfeOOd) . 
A full description on how the closure phase and closure phase 
errors are computed wil l be part of the sec ond paper on the 
AMBER data reduction dMillour et all2006l) . 

5.6. Differential phase and piston 

An example of differential phases is given Figure |5] It is com- 
puted from the ensemble average of the cross spectrum as de- 
fined in the estimator of Eq. (I30i . Frame-by-frame correction 
of its linear part (i.e. unwrapping) has been performed. The re- 
sulting differentia l phase shows a typica l rotation signal that is 
fully described in lMeilland et al Currently, as the clo- 

sure phase, the internal error bars are computed statistically as- 
suming that the differential phases are statistically independent 
frame to frame. An extensive description of the data processing 
and of the informations that can brin g the differential ph ases 
will be described in our second paper dMillour et all2006l) . 

The computation of the linear component of the differen- 
tial phase, that is the piston estimation is done on each spectral 
band separately (J, H or K), using the least square method de- 
scribed in Sec tion l3. 5.41 This algorithm has been extensively 



tested on the sky and validated as a part of the Observing 
Software of the AMBER instrument. An example of the fit- 
ting process as well as of the piston estimate is given in Figure 

cm 

6. Conclusions 

We have described in this paper the data reduction formalism of 
the VLTI/ AMBER instrument, that is the principles of the algo- 
rithm that lead to the computation of the AMBER observables. 
This innovative signal processing is performed in three main 
steps: (i) the calibration of the instrument which provides the 
calibration matrix that gives the linear relationship between the 
interferogram and the complex visibility; (ii) the inversion of 
the calibration matrix to obtain the so-called P2 VM matrix then 
the complex visibility and; (iii) the estimation of the AMBER 
observables from the complex visibility, namely the squared 
visibility, the closure phase and the differential phase. 

Note that this analysis requires that the calibration matrix 
must be both perfectly stable in time and very precise, that is 
recorded with a SNR much higher than the SNR of the interfer- 
ograms. If the instrument is not stable between the calibration 
procedures and the observations, the P2VM will drift and as 
a result, the estimated observables will be biased. And if the 
calibration is not precise enough, it will be the limiting fac- 
tor of the SNR of the observables. For the latter problem, it 
is thus recommended to set, during the calibration process, an 
integration time that insures a P2VM accuracy of at least a fac- 
tor of 10 higher than the accuracy expected on the measure- 
ments. To check the former problem of stability, it is advised 
to record one P2VM before and one P2VM directly after the 
observation. This procedure allows to quantify the drift of the 
instrument along the observations and to potentially reject the 
data is the drift appears to be too important. Note however that 
stability measurements in laboratory have shown the AMBER 
instrument to be generally stable at the hour scale at least. 

Regarding the closure phase and the differential phase, we 
have produced here the theoretical estimators arising from the 
AMBER data reduction specific technique, as well as brief il- 
lustrations from real observations. A thorough analysis, that 
is practical issues and performances, of these two observables 
which deal the phase of the complex visi bility will be given in 
a forthcoming paper dMillour et alfeOOd) 

For the squared visibility, we have defined an estimator that 
is self-calibrated from the instrumental contrast, and we have 
investigated its biases. The quadratic bias, which is an addi- 
tive quantity and results in the quadratic estimation in presence 
of zero-mean value additive noise, can be easily corrected, pro- 
viding the computation of the error of the fringe measurements. 
Atmospheric and instrumental biases, which attenuate in a mul- 
tiplicative manner the visibility, come respectively from the 
high frequency fringe motion during the integration time - 
namely the jitter -, and from the loss of spectral coherence 
when the fringes are not centered at the zero optical path dif- 
ference - that is the atmospheric differential piston. The latter 
can be estimated from the differential phase and its consecutive 
attenuation can be corrected knowing the shape of the spec- 
tral filter and the resolution of the spectrograph. The former, 
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Fig. 10. Piston estimation from the fringe pattern. From left to right is (i) the raw fringe pattern, the corresponding phase; (ii) the 
estimated linear component of the phase from the least square fit and; (iii) a piston time-sequence over 250 secon ds. Note that 
the pi ston rms is around 15jum, which is in agreement with the average atmospheric conditions recorded in Paranal jMartin et alJ 
1200(1 



when strictly arising from atmospheric turbulence, can be cal- 
ibrated by a reference source, providing it has been observed 
shortly before/after the object of interest. When instrumental, 
hardly calibratable vibrations add themselves in the jitter phe- 
nomenon, as it is presently the case for the VLTI, we propose 
a method based on sample selection that allows to reduce the 
attenuation and the associated dispersion on the visibilities. 

However at this point, because of the presence of these 
instrumental vibrations, and because of the absence of the 
FINITO fringe tracker as well, it is neither possible to develop 
optimized tool to identify and calibrate the biases coming from 
the atmospheric turbulence, nor to present an analysis of the 
ultimate performances of the VLTI/ AMBER instrument. These 
points will be developed in our next paper on the AMBER data 
reduction methods, once the problems mentioned above, which 
are independent of the AMBER instrument, will have been re- 
solved. 
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